The effect of gender on emotional reactions and perceptions when individuals meet themselves in immersive virtual reality.

Immersive virtual reality-based training and research are becoming more and more popular and are in continuous development. For instance, it is now possible to be trained by one's virtual self (i.e., doppelganger), meaning that a trainee can participate in a training program in which the trainer resembles the trainee. While past research involving doppelgangers showed promising results, findings revealed gender effects such that doppelganger-based training seems to be beneficial only for male trainees. In the present research, we contribute to this literature by investigating the emotional reactions and perceptions that people have when they meet a virtual human in immersive virtual reality. Specifically, we assess the extent to which the appearance of the virtual human (doppelganger vs. unknown avatar) and an individual's gender influence these reactions and perceptions. We found that males felt more positive emotions toward their doppelganger than toward the unknown avatar and that females perceived their doppelganger as less competent and warm than the unknown avatar. Our findings have important practical implications in terms of virtual reality-based training and research design such that the use of a doppelganger (unknown avatar) might be recommended in a training program or research setting involving men (women).

A deepfake-based study on facial expressiveness and social outcomes.

Artificial intelligence (AI)-generated media is used in entertainment, art, education, and marketing. AI-generated faces or facial expressions using deepfake-based technologies might also contribute to nonverbal behavior studies. As a proof of concept, in this research, we test the replicability of past results regarding the positive effects of facial expressiveness (e.g., gazing, nodding, and smiling) on social outcomes. Because the facial expressions when listening to someone (i.e., nonverbal immediacy) encompass several behaviors that are typically related (i.e., smiling while nodding), the effect of combinations of these behaviors is challenging to study. We thus test the effect of facial expressiveness (gazing, nodding, and smiling vs. none) on first impression judgements in a job interview setting using AI-generated experimental video material. We measure how competent, warm, and favorably independent observers (n = 823) perceive the targets (n = 159) showing AI-generated facial expressions. Our results replicate past research showing that the more targets are facially expressive, the more they are perceived favorably. Apart from supporting evidence of the importance of facial expressiveness for conveying a positive impression, we show the benefits of relying on AI-generated experimental video material for the study of nonverbal behavior.